Building a Disciplinary, World-Wide Data Infrastructure

Sharing scientific data, with the objective of making it fully discoverable, accessible, assessable, intelligible, usable, and interoperable, requires work at the disciplinary level to define in particular how the data should be formatted and described. Each discipline has its own organization and history as a starting point, and this paper explores the way a range of disciplines, namely materials science, crystallography, astronomy, earth sciences, humanities and linguistics get organized at the international level to tackle this question. In each case, the disciplinary culture with respect to data sharing, science drivers, organization and lessons learnt are briefly described, as well as the elements of the specific data infrastructure which are or could be shared with others. Commonalities and differences are assessed. Common key elements for success are identified: data sharing should be science driven; defining the disciplinary part of the interdisciplinary standards is mandatory but challenging; sharing of applications should accompany data sharing. Incentives such as journal and funding agency requirements are also similar. For all, it also appears that social aspects are more challenging than technological ones. Governance is more diverse, and linked to the discipline organization. CODATA, the RDA and the WDS can facilitate the establishment of disciplinary interoperability frameworks. Being problem-driven is also a key factor of success for building bridges to enable interdisciplinary research.Comment: Proceedings of the session "Building a disciplinary, world-wide data infrastructure" of SciDataCon 2016, held in Denver, CO, USA, 12-14 September 2016, to be published in ICSU CODATA Data Science Journal in 201

ESASky v.2.0: all the skies in your browser

With the goal of simplifying the access to science data to scientists and citizens, ESA recently released ESASky (http://sky.esa.int), a new open-science easy-to-use portal with the science-ready Astronomy data from ESA and other major data providers. In this presentation, we announced version 2.0 of the application, which includes access to all science-ready images, catalogues and spectra, a feature to help planning of future JWST observations, the possibility to search for data of all (targeted and serendipitously observed) Solar System Objects in Astronomy images, a first support to mobile devices and several other smaller usability features. We also discussed the future evolution of the portal and the lessons learnt from the 1+ year of operations from the point of view of access, visualization and manipulation of big datasets (all sky maps, also called HiPS) and large catalogues (like e.g. the Gaia DR1 catalogues or the Hubble Source Catalogue) and the design and validation principles for the development of friendly GUIs for thin layer web clients aimed at scientists.Comment: 4 pages, 2 figures, ADASS 2017 conference proceeding

The VO: A Powerful Tool for Global Astronomy

Since its inception in the early 2000's, the Virtual Observatory (VO), developed as a collaboration of many national and international projects, has become a major factor in the discovery and dissemination of astronomical information worldwide. The International Virtual Observatory Alliance (IVOA) has been coordinating all these efforts worldwide to ensure a common VO framework that enables transparent access to and interoperability of astronomy resources (data and software) around the world. The VO is not a magic solution to all astronomy data management challenges but it does bring useful solutions in many areas borne out by the fact that VO interfaces are broadly found in astronomy's major data centres and projects worldwide. Astronomy data centres have been building VO services on top of their existing data services to increase interoperability with other VO-compliant data resources to take advantage of the continuous and increasing development of VO applications. VO applications have made multi-instrument and multi-wavelength science, a difficult and fruitful part of astronomy, somewhat easier. More recently, several major new astronomy projects have been directly adopting VO standards to build their data management infrastructure, giving birth to ‘VO built-in' archives. Embracing the VO framework from the beginning brings the double gain of not needing to reinvent the wheel and ensuring from the start interoperability with other astronomy VO resources. Some of the IVOA standards are also starting to be used by neighbour disciplines like planetary sciences. There is still quite a lot to be done on the VO, in particular tackling the upcoming big data challenge and how to find interoperable solutions to the new data analysis paradigm of bringing and running the software close to the data. We report on the current status and also desire to encourage others to adopt VO technology and engage them in the effort of developing the VO. Thus, we wish to ensure that the VO standards fit new astronomy projects requirements and needs

The VO: A Powerful Tool for Global Astronomy

Since its inception in the early 2000's, the Virtual Observatory (VO), developed as a collaboration of many national and international projects, has become a major factor in the discovery and dissemination of astronomical information worldwide. The International Virtual Observatory Alliance (IVOA) has been coordinating all these efforts worldwide to ensure a common VO framework that enables transparent access to and interoperability of astronomy resources (data and software) around the world. The VO is not a magic solution to all astronomy data management challenges but it does bring useful solutions in many areas borne out by the fact that VO interfaces are broadly found in astronomy's major data centres and projects worldwide. Astronomy data centres have been building VO services on top of their existing data services to increase interoperability with other VO-compliant data resources to take advantage of the continuous and increasing development of VO applications. VO applications have made multi-instrument and multi-wavelength science, a difficult and fruitful part of astronomy, somewhat easier. More recently, several major new astronomy projects have been directly adopting VO standards to build their data management infrastructure, giving birth to ‘VO built-in' archives. Embracing the VO framework from the beginning brings the double gain of not needing to reinvent the wheel and ensuring from the start interoperability with other astronomy VO resources. Some of the IVOA standards are also starting to be used by neighbour disciplines like planetary sciences. There is still quite a lot to be done on the VO, in particular tackling the upcoming big data challenge and how to find interoperable solutions to the new data analysis paradigm of bringing and running the software close to the data. We report on the current status and also desire to encourage others to adopt VO technology and engage them in the effort of developing the VO. Thus, we wish to ensure that the VO standards fit new astronomy projects requirements and needs

Science Archives at the ESAC Science Data Centre

<p>The ESAC Science Data Centre (ESDC) provides services and tools to access and retrieve science data from all ESA space science missions (astronomy, planetary and solar heliospheric). The ESDC consists of a team of scientists and engineers working together and in very close collaboration with Science Ground Segments teams. The large set of science archives located at ESAC represent a major research asset for the community, as well as a unique opportunity to provide multi missions and multi wavelength science exploitation services. ESAC Science Archives long term strategy is set along the main three axes: (1) enable maximum scientific exploitation of data sets; (2) enable efficient long-term preservation of data, software and knowledge, using modern technology and, (3) enable cost-effective archive production by integration in, and across, projects The author wants to thanks all the people from the ESAC Science Data Centre and the mission archive scientists who have participated to the development of the archives and services presented in this paper.</p